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(57) Abstract: If a scene specifying button (202) is pressed while a TV program is being viewed (S601), scene specification infor- 
mation including a point in time, a channel, and the like is generated (S602). The broadcast data of a scene corresponding to this 
scene specification information is retrieved from a related information storage section 404 (S603). The retrieved broadcast data is 
subjected to format conversion so as to become text data (S604). The text obtained by the format conversion is put into the body of 
an electronic mail (S605). After a complementary addition is made to the body of the electronic mail as necessary (S606 and S607), 
the electronic mail which is completed is transmitted to a destination user (S608). This makes it possible to create a mail easily and 
accurately, so that a conmiunication system that fiilfills the necessity of inmiediate response is realized. 
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DESCRIPTION 

DATA RECEPTION TERMINAL AND MAIL CREATION METHOD 

TECHNICAL FIELD 
The present invention relates to a data reception terminal 
and a mail creation method, andmore particularly to a data reception 
terminal that creates, by utilizing information associated with 
multimedia data (e.g., images, sounds, and the like) which is 
received via broadcast, communication, or the like, an electronic 
mail relating to the multimedia data and a mail creation method 
to be performed in the data reception terminal. 

BACKGROUND ART 
In recent years, TV program broadcast has been experiencing 
a rapid conversion from analog to digital form. The digital 
broadcast has been putting various services, which had been 
difficult for the analog broadcast to provide, to practical use. 
One example is data broadcasting services. According to a data 
""broadcasting service, ai user who'is viewiltig a TV program is capable 
of easily obtaining information such as weather forecast, a 
homepage URL of the TV program that is being viewed, and the like, 
via broadcast. As a description format for data which is used 
in the data broadcasting service, BML (Broadcast Markup Language) 
is generally known. 
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Meanwhile, the sophistication of functionality of mobile 
phones has been progressing rapidly. Conventionally, a main 
service provided by mobile phones has been voice communication, 
but at present, homepage browsing and electronic mail are 
5 indispensable . In particular, electronic mail has been replacing 
voice communication as a main service. 

With the situation as described above, in recent years, as 
mobile phones are beginning to have a digital broadcast receiving 
function, a compound service combining a digital broadcast 

10 receiving function and a mail communication function is proposed. 
The ^^compound service" refers to, for example, a service in which, 
if a user specifies a scene while viewing a TV program, an electronic 
mail containing attached information relating to the specified 
scene (scene-related information) is transmitted to a designated 

15 destination. Here, a ^^scene" refers to a part of a TV program, 
and means broadcast data which is uniquely specified by time, a 
channel that identifies the program, and/or the like. 

An exemplary structure of a conventional mobile phone which 
realizes such a compound service is shown in FIG. 12. As shown 

20 in FIG. 12, the conventional mobile phone includes a broadcast 
receiving section 1201, a decoding section 1202, an video/audio 
output section 1203, a related information storage section 1204, 
a related information retrieval section 1205, an input/output 
acceptance section 1206, a mail creation section 1208, and a mail 

25 communication section 1209 . The broadcast receiving section 1201 
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receives multiplexed data of a TV program which is broadcast from 
a TV station. The decoding section 1202 separates the received 
multiplexed data into video/audio data and broadcast data. The 
video/audio output section 1203 outputs video and audio. The 
5 related information storage section 1204 stores and manages the 
broadcast data. The input /output acceptance section 1206 detects 
a user's specifying of a scene, and generates predetermined scene 
specification information. The related information retrieval 
section 1205 retrieves corresponding scene-related information 

10 based on the scene specification information. The mail creation 
section 1208 creates an electronic mail to which is attaiched the 
retrieved scene-related information. The mail communication 
section 1209 transmits the created electronic mail. 

In the conventional technology above, however, although it 

15 is possible to automatically attach, as scene-related information, 
information such as the URL of a homepage of a TV program or the 
like to an electronic mail, a user has to input and create by 
operating keys as often as necessary a content the user desires 
to convey to the other party as the body of the electronic mail. 
. 20 ._As a result, there -oecurs a problem in that it takes" a long time 
from when a scene is specified until an electronic mail is 
transmitted. Consequently, in the case of a TV program in which 
scenes change from moment to moment, it is conceivable that a scene 
irrelevant to the content of an electronic mail is being broadcast 

25 at the moment that the transmission of the electronic mail is 

3 



wo 2005/041529 ^^PCT/JP2004/013382 



completed. This problem also applies to the case where the 
multimedia data is music which is broadcast from a radio station. 

Therefore, an object of the present invention is to provide 
a data reception terminal and a mail creation method which, in 
5 the case where information related to multimedia data is to be 
transmitted via electronic mail, makes it possible to perform the 
creation of an electronic mail easily and accurately, by providing 
assistance in user input operation when creating the body of the 
electronic mail. 

10 

DISCLOSURE OF THE INVENTION 
The present invention is directed to a data reception 
terminal for receiving multiplexed data obtained by multiplexing 
multimedia data including at least video or audio and scene-related 

15 information related to the multimedia data, and creating an 
electronic mail by utilizing the multiplexed data. To achieve 
the Ob j ect above, a data reception terminal according to the present 
invention comprises a receiving section, a decoding section, an 
output section, a storage section, an input/output acceptance 

20 section, a retrieval section,- a format conversion section, and 
a mail creation section. 

The receiving section receives the multiplexed data. The 
decoding section separates the received multiplexed data into the 
multimedia data and the scene-related information. The 

25 input/ output acceptance section generates , in response to a request 
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from a user, scene specification information for identifying a 
portion of the multimedia data that is being outputted from the 
output section, the scene specification information including 
identification information and time. The retrieval section 
5 retrieves, from the storage section, scene-related information 
corresponding to the scene specification information. The format 
conversion' section converts the ..retrieved scene-related 
information into a format which enables the scene-related 
information to be used in the electronic mail. The mail creation 
10 section creates a part of data of the electronic mail by utilizing 
the converted scene-related information. 

Here, preferable methods for creating an electronic mail 
employed by the mail creation section are, for example: creating 
a body section of the data of the electronic mail from the 
• 15 scene-related information; setting, as a subject of the electronic 
mail, a part of the scene-related information corresponding to 
a title; and displaying, in the electronic mail, data of the 
electronic mail created from the scene-related information in a 
form different from that of any other information contained in 
20 - the electronic mail. It is desirable that data of the electronic 
mail created from the scene-related information be protected so 
that a content of the scene-related information is not allowed 
to be changed. 

The processes performed by the afore-mentioned components 
25 of the data reception terminal can be regarded as a mail creation 
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method defining a sequence of processing steps. This method is 
provided in the form of a program for causing a computer to execute 
the series of processes. This program may be introduced into the 
computer via a computer-readable recording mediiim having the 
program recorded therein. In addition, all or some of the 
functional blocks that constitute the afore-described data 
reception terminal may be realized as an LSI , which is an integrated 
circuit. 

As described above, according to the present invention, text 
data (i.e., scene-related information) for an electronic mail is 
extracted from information associated with a specified scene. 
Consequently, it becomes possible to create the electronic mail 
in a short time and with ease. In particular, the body of an 
electronic mail can be created by only inputting words to be added 
between text data. Moreover, the operation of inputting the 
subject of an electronicmailby a user can be omitted. Furthermore, 
it is possible to visually distinguish between scene-related 
information and a part inputted by a user within the body of an 
electronic mail . 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG . 1 is a diagraim illustrating an outline of a communication 
system to which a data reception terminal of the present invention 
is applied. 

FIG. 2 is an external view of an exemplary data reception 

6 
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terminal according to an embodiment of the present invention. 

FIG, 3 is a diagram illustrating a typical hardware 
configuration for realizing a data reception terminal* 

■ FIG. 4 is a diagram illustrating a software configuration 
5 of a data reception terminal which employs a mail creation method 
.according to an embodiment of the present invention. 

FIG. 5 is a flowchart of the processes concerning a broadcast 
receiving function of a data reception terminal. 

FIG. 6 is a flowchart of. the processes concerning an 
10 electronicmail transmission function of a data-reception terminal . 

FIG. 7 is a diagram illustrating a specific example of 
broadcast data which is associated with multimedia data. 

FIG. 8A and FIG. 8B are diagrams illustrating specific 
examples of scene specification information. 
15 FIG. 9A and FIG. 9B are diagrams illustrating an example 

where a plurality of services are provided by one channel. 

FIG . 10 is a diagram illustrating an exemplary display screen 
in which scene-related information is put in an electronic mail. 

FIG . 11 is a diagram illustrating an exemplary display screen 
20 after the body of the electronic mail shown in FIG. 10 has been 
edited. 

FIG. 12 is a diagram illustrating a software configuration 
of a conventional mobile phone. 

25 BEST MODE FOR CARRYING OUT THE INVENTION 



7 
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An embodiment of the present invention is described below 
with reference to the accompanying drawings. 

Firstly, there is described an outline of a communication 
system in which a multimedia digital distribution service and an 
electronic mail service are combined, and to which a data reception 
terminal of the present invention is applied. FIG. 1 illustrates 
an example where a TV program composed of multimedia data including 
video, audio, and various data is distributed from a broadcasting 
station 101 to a data reception terminal 102 via digital broadcast . 
From the broadcasting station 101, multiplexed data obtained by 
multiplexing multimedia data and accompanying data (which, in this 
example, is data for use in data broadcast) related to the multimedia 
data is broadcast. The present invention can be applied to any 
system in which multimedia data and accompanying data are inputted 
synchronously. Therefore, multimedia data maybe data for a radio 
program using only sounds, instead of data for a TV program, and 
the distribution form of multimedia data is not restricted to 
broadcast but may be communication. 

As shown in FIG. 1, a communication system of the present 
inventibn includes' a 'broadcasting station 101, a ^ata reception 
terminal 102, a base station 103, a communication network 104, 
a base station 105, and a general-user terminal 106. The 
broadcasting station 101 and the data reception terminal 102 have 
a function relating to broadcast, and the data reception terminal 
102 and the general-user terminal 106 have a function relating 

8 
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to electronic mail. The base station 103^ the base station 105, 
and the communication network 104 relay an electronic mail which 
is exchanged between the data reception terminal 102 and the 
general-user terminal 106. 

The data reception terminal 102, which is a characteristic 
feature of the present invention, is a terminal that has both a 
broadcast function which enables the reception of broadcast data 
and a communication function which enables the transmission and 
reception of an electronic mail, and is typically a mobile phone 
as illustrated in FIG. 2 - If a user of the data reception terminal 
102 who is viewing a TV program (which is being displayed on a 
display screen 201) finds himself or herself seeing an interesting 
scene which he or she desires to convey to another user, a scene 
specifying button 202 is pressed. This operation enables the 
acquisition of a point in time at which the scene specifying button 
202 has been pressed, information for identifying the TV program 
that has been viewed at the time, and information related to the 
TV program. This acquisition process will be described in detail 
later. 

- FIG. "3 is a dxagram illustrating 'a typical hardware 
configuration for realizing a data reception teinninal 102 of the 
present invention . As shown in FIG . 3 , the data reception terminal 
102 includes a receiving section 301 for receiving a broadcast 
wave via an antenna, an output section 302 which is connected to 
a loudspeaker and/or the display screen 201, a storage section 
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303 for storing decoded broadcast data, a communication section 

304 for perf canning the transmission and reception of an electronic 
mail via the antenna or the like, a CPU 305 that takes charge of 
the overall control of the terminal, a ROM 306 for storing a program, 
a RAM 307 that is utilized for the execution of the program, a 
button input section 308 that includes the scene specifying button 
202, and so on. All of these components are connected with one 
another. 

In the ROM 3 0 6 , a software program for implementing the system 
is stored. The CPU 305 executes the program stored in the ROM 
306, and performs a writing or updating of occurring data onto 
the KPJA 307. In addition, as a result of executing the program, . 
the CPU 305 receives at the receiving section 301 a broadcast wave 
which is distributed from the broadcasting station 101 , and outputs , 
via the output section 302, audio and video to the loudspeaker 
and the display screen 201, respectively. Further, the CPU 305 
accepts a key input by the user via the scene specifying button 
202 which is connected to the button input section 308 - Furthermore, 
the CPU 305 performs a transmission or reception of an electronic 
mail via the antenna which is connected to the communication section 
304. 

In the above, the data reception terminal 102 of the present 
invention has been described in terms of hardware configuration. 
Next, a characteristic mail creation method that the data reception 
terminal 102 of the present invention employs by utilizing at least 

10 
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some of those hardware components is described in terms of software 
configuration . 

FIG. 4 is a diagram illustrating a software configuration 
of a data reception terminal 102 which employs the mail creation 

5 method according to an embodiment of the present invention. By 
being read by the CPU 305, the program stored in the ROM 306 as 
shown in FIG. 3 realizes the functions as a data reception section 
401, a decoding section 402, an video/audio output section 403, 
a related information storage section 404, a related information 

10 retrieval section 405, an input/output acceptance section 406, 
a format conversion section 407, a mail creation section 408, and 
a mail communication section 409. 

The data reception section 401 receives multiplexed data 
of a TV program which is broadcast from the broadcasting station 

15 101. The decoding section 402 separates the received multiplexed 
data into video/audio data and accompanying data that contains 
scene-related information, which is information related to a scene 
of a TV program. The video/audio output section 403 outputs video 
and audio. The related information storage section 404 stores 

20 and manages the accompanying data. The input /output acceptance 
section 406 detects a user's specifying of a scene, and generates 
predetermined scene specification information. The related 
information retrieval section 405 retrieves corresponding 
scene-related information based on the scene specification 

25 information. The format conversion section 407 converts the 
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retrieved scene-related information into a format which enables 
the retrieved scene-related information to be put into an 
electronic mail. The mail creation section 408 creates an 
electronic mail in which the scene-related information having been 
5 subjected to the format conversion is used. The mail communication 
section 409 transmits the created mail to the general-user terminal 
106. 

FIG. 5 and FIG. 6 are flowcharts illustrating the process 
procedure of the mail creation method according to the embodiment 

10 of the present invention, employed by the data reception terminal 
102 as constructed as described above. FIG. 5 is a flowchart of 
the processes concerning a broadcast receiving function, and FIG. 6 
is a flowchart of the processes concerning an electronic mail 
transmission function. 

15 With reference to FIG. 5, the processes concerning the 

broadcast receiving function are described. If the data reception 
terminal 102 receives a broadcast wave from the broadcasting 
station 101 (step S501) , the data reception terminal 102 performs 
a decoding process on the broadcast wave (step S502) . The data 

20 reception terminal 102 outputs the video/audio data separated by 
the decoding to the display screen 201 or the loudspeaker, and 
stores the broadcast data separated by the decoding in the related 
information storage section 404 (step S503) . The broadcast data 
to be stored in the related information storage section 404 is 

25 data described in a program description language such as BML or 

12 
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the like. The above processes are performed continuously while 
broadcast waves are being received (step S504) . 

With reference to FIG. 6, the processes concerning the 
electronic mail transmission function are described. If the user 
5 presses the scene specifying button 202 while viewing a TV program 
(step S601)^ the data reception terminal 102 generates scene 
specification information which includes a time^ a channel, and/or 
the like (step S602) . For example, in the case where the user 
viewing a TV program with the data reception terminal 102 attempts 
10 to transmit a scene 701 illustrated in FIG. 7 to another user via 
mail, the scene specification information includes a time 801 at 
which the scene specifying button 202 is pressed, a viewing channel 
802 on which the specified scene is broadcast, and/or the like 
(FIG. 8A) . In the case where the user attempts to transmit a scene 
15 702 illustrated in FIG. 7 to another user via mail, the scene 
specification information includes a time 804 at which the scene 
specifying button 202 is pressed, a viewing channel 805 on which 
the specified scene is broadcast, and/or the like (FIG. 8B) . Scene 
specification information refers to data which is capable of 
20 -uniquely identifying broadcast data, and may bet contents ID 
of a TV program or the like. 

Here, with reference to FIG. 9A and FIG. 9B, a supplementary 
description is given concerning channels. In Japan, the 
multiplication of channels can be pointed out as a characteristic 
25 feature of digital broadcast, as known in BS digital broadcast. 

13 
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Although only one program can be assigned to one channel in the 
case of conventional analog broadcast, digital broadcast makes 
it possible to assign a plurality of programs to one channel. 
Usually, a plurality of programs included in one channel are 
distinguished by identifiers called service channels. 

Therefore, as shown in FIG. 8A and FIG. 8B, in the case where 
a plurality of pieces of scene specification information represent 
the same channel, respective corresponding broadcast data are 
identified by service channels 803 and 806 along with channels 
802 and 805, The service channels are used not only for 
distinguishing between utterly different programs but may also 
be used when the user selects a necessary service in the case where 
a plurality of services 902 are provided by one program, for example 
(FIG. 9A) . 

With regard to terrestrial digital broadcasting, in the case 
of digital broadcast for a radio or a mobile terminal such as a 
mobile phone and the like, broadcast data is divided into thirteen 
segments, and at least some of the divided segments combined are 
put to use (FIG. 9B) . For example, the thirteen segments may be 
allocated among three" applications: a mobile terminal, a radio, 
and a stationary terminal . A mobile terminal on the receiver side 
may receive one segment of the broadcast data 903 from among the 
thirteen segments of the broadcast data in order to realize stable 
reception and/or power saving, and use the service of only viewing 
of a program titled ^^Docximentary ^Project X' • " Similarly, a radio 

14 
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may use a high-quality sound service in addition to the narration 
of the docxamentary, by employing three segments of the broadcast 
data 904, whereas a stationary terminal may use a service such 
as audience participation discussion in connection with the 
5 documentary, which is realized in the form of chats done with other 
viewers via the communication network 104 . 

As described above, in terrestrial digital broadcasting, 
combining of segments enables the utilization of different services , 
similarly to the services 902 in BS digital broadcast . Therefore, 
10 in the case where a plurality of services are included in one channel 
as a result of the digitization of broadcast, a method for 
identifying services, such as service channels, may also be 
incorporated into the scene specification information according 
to the present invention. 
15 With reference to FIG, 6 again, if the scene specification 

information is generated, the data reception terminal 102 retrieves , 
from the related information storage section 404, the broadcast 
data (e.g., BML data) of the scene corresponding to the scene 
specif ication information, i.e., scene-related information (step 
20 S603) . For example, the time 801 and channel 802 of the scene 
specification information is associated with a part of the 
broadcast data 703 stored in the related information storage 
section 404, i.e., information 704 . Consequently, the pressing 
of the scene specifying button 202 enables the -acquisition of the 
25 information 704. Similarly, the time 804 and channel 805 of the 
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scene specification information is associated with a part of the 
broadcast data 703, i.e., information 705- 

Next, the data reception terminal 102 performs the process 
of converting the format of the retrieved broadcast data so that 
the retrieved broadcast data can be used as scene-related 
information (step S604) . The scene-related information refers 
to text data relating to a scene, and includes, for example, a 
program title, a person appearing in the program, a description 
of the scene, information unknown to the user, and/or the like. 
In other words, this format conversion process corresponds to the 
process of extracting, from the information in the broadcast data, 
a text which is capable of being used in the body of an electronic 
mail. To give a specific explanation with reference to FIG. 7, 
the scene-related information refers to, within the broadcast data 
703, the title of a TV program placed between tags <title> and 
</title>, the name of a person appearing in or the name of a feature 
in the program placed between tags <mailText> and </mailText>, 
and so on. Then, the scene-related information obtained after 
the format conversion, i.e., the extracted text, is put into the 
body of an electronic mail (step S605) . 

FIG. 10 is a diagram illustrating an exemplary display screen 
showing scene-related information which is put in the body of an 
electronic mail. In the case where broadcast data 1001 includes 
scene-related information 1002 to 1005 and a video file 1006, 
^^MARATHON'' (i.e., the scene-related information 1002) placed 

16 



wo 2005/041529 



PCT/JP2004/013382 



between tags <title> and </title> within the broadcast data 1001 
is put into the subj ect 1009 of an electronic mail 1007 . In addition, 
^VOHN SMITH" (i.e., the scene-related information 1003), "'LAST 
SPURT'' (i.e., the scene-related information 1004 ) , and^^GOAL'' (i.e., 
the scene-related information 1005) placed between tags <mailText> 
and </mailText> are put into the body 1010 of the electronic mail. 
The video file 1006 is attached to the electronic mail as an attached 
file 1011. 

Note that text data extracted as scene-related information 
by the format conversion does not need to be defined by the tags 
<title> and </title> or the tags <mailText> and </mailText> as 
in the above-described example, but may be defined in any other 
manner . Moreover, there is no limitation as to which scene-related 
information is to be used in the subject. In the case where there 
is no scene-related information to be used in the subject, 
information of an identifier of broadcast data (e.g., the file 
name of a moving image, audio, a still image, or the like in a 
relevant scene; a contents ID; or the like) may be used as the 
subj ect of a mail . Furthermore , in the case of the above-described 
example, since it is assumed that broadcast data is written in 
BML, scene-related information is supposed to be text data. 
However, scene-related information may be binary data or the like 
as long as it is data usable for mail creation. 

If scene-related information has been put into the body of 
an electronic mail, the data reception terminal 102 determines 

17 
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whether it is necessary to edit the body of the electronic mail 
(stepS606) . The editing here refers to making sentences by adding 
words such as conjunctions, verbs, and the like to the scene-related 
information which is merely placed together as shown in FIG. 10, 
5 so that a content which the user wants to convey is clearly expressed . 
In the case of the example of FIG. 11, for example, ''"'S," ^^JUST 
BEFORE, " and "'MOVED ME'' are added in the body 1010 of the electronic 
mail, so that a body 1102 is obtained after this editing. In the 
body 1102 of the electronic mail that is displayed after the user 
10 has made the editing, it is preferable that the scene-related 
information and a part added by the user be distinguished from 
each other by underlining and/or using different colors of letters, 
for example. 

Depending on the broadcasting station 101, it may so happen 
15 that making a change to the scene-related information is 
undesirable to the broadcasting station 101. Such an example is 
scene-related information which corresponds to a part related to 
a person' s name, a part in which a copyright message is displayed, 
or the like. It is desirable that such scene-related information 
20 - be protected" against any eciit~ing by the user. This protection 
may be provided at the broadcasting station 101 side by defining 
a particular tag, or the data reception terminal 102 side may make 
a judgment and place a restraint as necessary. 

Note that the aforementioned technique of distinguishing 
25 user-added parts and the aforementioned technique of protecting 
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certain parts of the scene-related information, which have been 
described in connection with the body of an electronic mail, may 
also be applied to the subject part of an electronic mail. 

Then, the data reception terminal 102 performs a format 
conversion and a necessary editing (step S607) , and transmits the 
electronic mail, the editing of which has been completed, to a 
destination user (step S608) . 

As described above, according to a data reception terminal 
and a mail creation method according to the embodiment of the present 
invention, text data (i.e., scene-related information) to be used 
in an electronic mail is extracted from information associated 
with a specified scene. Consequently, it becomes possible to 
create an electronic mail easily and accurately. In particular, 
the body of an electronic mail can be created by only inputting 
words to be added between text data. Moreover, the operation of 
inputting the sub j ect of an electronic mail by a user can be omitted . ' 
Furthermore, it is possible to visually distinguish between 
scene-related information and a part inputted by a user within 
the body of an electronic mail. 
- - - Note that , "among t he f unct ionaT blbcks'of "the dat"a~ reception 
terminal according to the present invention, the decoding section 
402, the related information retrieval section 405, the format 
conversion section 407, and the mail creation section 408 are 
typically realized as an LSI, which is an integrated circuit (which 
is called an IC, a system LSI, a super LSI, an ultra LSI, or the 
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like depending on the degree of integration) (see FIG. 4) . Each 
functional block may be separately constructed in a chip form^ 
or all or some of the functional blocks may be constructed in a 
chip form. 

Moreover, the method of circuit integration is not limited 
to LSI, but may be realized by a dedicated circuit or a 
general-purpose processor. Furthermore, an FPGA (Field 
Programmable Gate Array) , which is an LSI that can be programmed 
after manufacture, or a reconf igurable processor enabling 
connections and settings of the circuit cells in the LSI to be 
reconfigured may be used. 

Still further, the advancement of semiconductor technology 
or another derivative technology may produce a technique for 
circuit integration that will replace LSI, in which case, as a 
matter of course, the integration of the functional blocks may 
be realized by utilizing that technique. A potential example is 
an application of biotechnology or the like. 

In addition, the mail creation method according to the 
present invention may be realized by a CPU interpreting and 
executing predetermined program data which is capable of carrying 
out the above-described process procedure, stored in a storage 
device (e.g., a ROM, a RAM, a hard disk, or the like). In this 
case, the program data may be introduced into the storage device 
via a recording medium such as a CD-ROM, a flexible disk, or the 
like, or may be executed directly from a recording medixom. 
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INDUSTRIAL APPLICABILITY 



A data reception terminal and a mail creation method of the 
present invention can be employed when information related to 
5 multimedia data is transmitted via an electronic mail, for example, 
and are particularly useful when it is hoped that the creation 
of an electronic mail be performed in a short time and with ease, 
for example. 



10 
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CLAIMS 

1 . A data reception terminal for receiving multiplexed data 
obtained by multiplexing multimedia data including at least video 
5 or audio and scene-related information related to the multimedia 
data, and creating an electronic mail by utilizing the multiplexed 
data, comprising: 

a receiving section operable to receive the multiplexed data; 
a decoding section operable to separate the received 
10 multiplexed data into the multimedia data and the scene-related 
information; 

an output section operable to output the separatedmultimedia 

data; 

a storage section operable to store the separated 
15 scene-related information; 

an input/output acceptance section operable to, in response 
to a request from a user, generate scene specification information 
for identifying a portion of the multimedia data that is being 
outputted from the output section, the scene specification 
20 information including identification information and time; 

a retrieval section operable to retrieve, from the storage 
section, scene-related information corresponding to the scene 
specification information; 

a format conversion section operable to convert the retrieved 
25 scene-related information into a format which enables the 
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scene-related information to be used in the electronic mail; and 
a mail creation section operable to create a part of data 
of the electronic mail by utilizing the converted scene-related 
information. 

2. The data reception terminal according to claim 1, 
wherein 

the mail creation section creates a body section of the data 
of the electronic mail from the scene-related information, 

3. The data reception terminal according to claim 1, 
wherein 

the mail creation section set s , as a sub j ect of the electronic 
mail, a part of the scene-related information corresponding to 
a title. 

4. The data reception terminal according to claim 1, 
wherein 

the mail creation section displays, in the electronic mail, 
data of the electronic mail created from the scene-related 
information in a form different from that of any other information 
contained in the electronic mail. 

5. The data reception terminal according to claim 1, 
wherein 
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data of the electronic mail created from the scene-related 
information is protected so that a content of the scene-related 
information is not allowed to be changed. 

5 6 . A mail creation method for receiving multiplexed data 

obtained by multiplexing multimedia data including at least video 
or audio and scene-related information related to the multimedia 
data, and creating an electronic mail by utilizing the multiplexed 
data, comprising: 
10 a step of receiving the multiplexed data; 

a step of separating the received multiplexed data into the 
multimedia data and the scene-related information; 

a step of outputting the separated multimedia data via an 
output section; 

15 a step of storing the separated scene-related information 

in a storage section; 

a step off in response to a request from a user, generating 
scene specification information for identifying a portion of the 
multimedia data that is being outputted from the output section, 
- 20 the- scene specification information 'including" identification 
information and time; 

a step of retrieving, from the storage section, 
scene-related information corresponding to the scene 
specification information; 
25 a step of converting the retrieved scene-related information 
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into a format which enables the scene-related information to be 
used in the electronic mail; and 

a step of creating a part of data of the electronic mail 
by utilizing the converted scene-related information. 

5 

7 . A computer-readable program for causing a data reception 
terminal to execute a mail creation method for receiving 
multiplexed data obtained by multiplexing multimedia data 
including at least video or audio and scene-related information 
10 related to the multimedia data, and creating an electronic mail 
by utilizing the multiplexed data, wherein 

the program causes the data reception terminal to execute: 
a step of receiving the multiplexed data; 
a step of separating the received multiplexed data 
15 into the "multimedia data and the scene-related information; 

a step of outputting the separated multimedia data 
via an output section; 

a step of storing the separated scene-related 
information in a storage section; 
20 ' a step of, in response to a request from a user, 

generating scene specification information for identifyirig a 
portion of the multimedia data that is being outputted from the 
output section, the scene specification information including 
identification information and time; 
25 a step of retrieving, from the storage section, 
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scene-related information corresponding to the scene 
specification information; 

a step of converting the retrieved scene-related 
information into a format which enables the scene-related 
information to be used in the electronic mail; and 

a step of creating a part of data of the electronic 
mail by utilizing the converted scene-related information. 

8 . A medium having recorded therein a computer-readable 
program for causing a data reception terminal to execute a mail 
creation method for receiving multiplexed data obtained by 
multiplexing multimedia data including at least video or audio 
and scene-related information related to the multimedia data, and 
creating an electronic mail by utilizing the multiplexed data, 
wherein 

the program causes the data reception terminal to execute: 

a step of receiving the multiplexed data; 

a step of separating the received multiplexed data 
into the multimedia data and the scene-related information; 

a step of output ting the separated multimedia data 
via an output section; 

a step of storing the separated scene-related 
information in a storage section; 

a step of, in response to a request from a user, 
generating scene specification information for identifying a 
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portion of the multimedia data that is being outputted from the 
output section, the scene specification information including 
identification information and time; 

a step of retrieving, from the storage section, 
scene-related information corresponding to the scene 
specification information; 

a . step of converting the retrieved scene-related 
information into a format which enables the scene-related 
information to be used in the electronic mail; and 

a step of creating a part of data of the electronic 
mail by utilizing the converted scene-related information. 

9 . An integrated circuit for use in a data reception terminal 
for receiving multiplexed data obtained by mult iplexing multimedia 
data including at least video or audio and scene-related 
information related to the multimedia data, and creating an 
electronic mail by utilizing the multiplexed data, wherein, 

the data reception terminal includes: a receiving section 
operable to receive the multiplexed data; an output section 
operable to output the multimedia data; a storage section operable 
to store the scene-related information; and an input/output 
acceptance section operable to, in response to a request from a 
user, generate scene specification infoinnation for identifying 
a portion of the multimedia data that is being outputted from the 
output section, the scene specification information including 
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identification information and time, and 

the integrated circuit integrates circuitry, functioning 

as : 

a decoding section operable to separate the received 
multiplexed data into the multimedia data and the scene-related 
information; 

a retrieval section operable to retrieve, from the 
storage section, scene-related information corresponding to the 
scene specification information; 

a format conversion section operable to convert the 
retrieved scene-related information into a format which enables 
the scene-related information to be used in the electronic mail; 
and 

a mail creation section operable to create a part of 
data of the electronic mail by utilizing the converted 
scene-related information. 
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